Thermalization of random motion in weakly confining potentials 
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We show that in weakly confining conservative force fields, a subclass of diffusion-type (Smolu- 
chowski) processes, admits a family of "heavy-tailed" non-Gaussian equilibrium probability density 
functions (pdfs), with none or a finite number of moments. These pdfs, in the standard Gibbs- 
Boltzmann form, can be also inferred directly from an extremum principle, set for Shannon entropy 
under a constraint that the mean value of the force potential has been a priori prescribed. That 
enforces the corresponding Lagrange multiplier to play the role of inverse temperature. Weak con- 
fining properties of the potentials are manifested in a thermodynamical peculiarity that thermal 
equilibria can be approached only in a bounded temperature interval < T < T max = 2eo/fes, 
where eo sets an energy scale. For T > Tmax no equilibrium pdf exists. 

PACS numbers: 05.40.Jc, 02.50.Ey, 05.20.-y, 05.10.Gg 
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We depart from a folk lore assumption that a thermo- 
dynamical system has a state characterized by a proba- 
bility density, ij. That amounts to studying (random) 
dynamical systems in terms of time-dependent probabil- 
ity density functions (pdfs) and discovering whether and 
how the system may approach a state of thermodynami- 
cal equilibrium. Localization properties of pdfs, both far 
from and at equilibrium, can be quantified in terms of 
Shannon entropy. Admissible dynamical equilibria can 
be inferred from various variational principles. 

At this point we invoke a classification of maximum 
entropy principles (MEP) as given in Ref. Q. Let us 
look for pdfs that derive from so-called first inverse MEP: 
given a pdf p(x), choose an appropriate set of constraints 
such that p(x) is obtained if Shannon measure of entropy 
is maximized (strictly speaking, extremized) subject to 
those constraints. 

Namely if a system evolves in a potential V(x) (at the 
moment, we consider a coordinate x to be dimensionless), 
we can introduce the following functional 



L{p{x)} = -X f 

J — t 



V(x)p(x)dx — / p(x) ln[p(x)]dx, 

J — oo 

(1) 

where (without limitation of generality) we consider the 
one-dimensional case. The first term comprises the mean 
value of a potential. A constant A is (as yet physi- 
cally unidentified) Lagrange multiplier, which takes care 
of aforementioned constraints. The second term stands 
for Shannon entropy of a continuous (dimensionless) pdf 
p(x). An extremum of the functional L{p(x)} can be 
found by means of standard variational arguments and 
gives rise to the following general form of an extremizing 
pdf 



,9*0) = Cexp(-AV(x)), 



(2) 



which, if regarded as the Gibbs-Boltzmann pdf, implies 
that the parameter A can be interpreted as inverse tem- 
perature, A = (fcsT) -1 (kg is Boltzmann constant), at 



which a state of equilibrium (asymptotic pdf) is reached 
by a random dynamical system in a confining potential 
V(x). 

A deceivingly simple question has been posed in chap. 
8.2.4 of Ref. [2j. Having dimensionless logarithmic po- 
tential V{x) = ln(l + x 2 ), one should begin with evalu- 
ating a mean value U = (V) = Jf° V{x)p{x)dx. Next 
one needs to show that only if this particular value is 
prescribed in the above MEP procedure, Cauchy distri- 
bution will ultimately arise. Additionally, one should 
answer what kind of distribution would arise if any other 
positive expectation value is chosen. The answer proves 
not to be that straightforward and we shall analyze this 
issue below. 

To handle the problem we admit all pdfs p(x) for which 
the mean value (ln(l + x 2 )) exists, i.e. takes whatever 
finite positive value. Then, we adopt the previous vari- 
ational procedure with the use of Lagrange multipliers. 
This procedure shows that what we extremize is not the 
(Shannon) entropy itself, but a functional F with a clear 
thermodynamic connotation (Hclmholtz free energy ana- 
log, 1): 

<P{x) = aV(x) + lnp(x) — >• J" = ($) = a(V)-S(p). (3) 

Here S(p) = —(hip) and a is a Lagrange multiplier. 
From now on we, we consider a parameter multiplier in 
the form a = coA^sT), where eo is characteristic en- 
ergy scale of a system. Note that Eq. (3), provides a 
dimensionless version of a familiar formula F = U — TS, 
relating the Helmholtz free energy F, internal energy U 
and entropy S of a random dynamical system. 
The extremum condition for F 
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yields an extremizing pdf in the form 

f 



Pa(x) 



(l + x 2 ) 



2\-a 



(4) 



(5) 
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FIG. 1: ln(l + x 2 ) against p a (x) with 1/2 < a < 1. 



FIG. 2: U a (curve 1) and its asymptotic expansion at large a 
(curve 2). 



provided the normalization factor Z a — (1 + 

x 2 )~ a dx exists. It turns out that the integral can be 
evaluated explicitly in terms of T - functions 



V^I> - 1/2) 

r( Q ) ' 



a > 1/2, 



(0) 



so that we can in principle deduce a numerical value of 
the parameter a, by resorting to our assumption that the 
mean value (V) Q has actually been fixed. 

We observe that the extremizing pdfs p a ([5]) appear to 
constitute a one-parameter family of pdfs, named by us 
Cauchy family, |3j, |4j • It is seen from Eq. ([6]) that the ex- 
tremizing functions ([5|) are normalizable only for a > 1/2 
as at a — > 1/2 we have Z a — > 00. We illustrate this be- 
havior in Fig. [TJ which shows that as a —> 1/2 the whole 
pdf p a {x) becomes identically equal to zero. To deduce 
the values of above dimensionless inverse temperature a, 
we need an explicit expression for the mean value 



U a = (V) a = 



T(a) 



0Fr(a - 1/2) J_ x (l+x 2 )<* 



ln(l + x 2 ) 



dx. (7) 



It turns out that it can be given in terms of digamma 
function i/j(x) — d(lnT)/dx |g]. We get 



2n 



sin(27ra) 



+ -0(1 — a) — ip 



a 



a > 



1 



(8) 



The dependence of U a on a is reported in Fig. [2] where 
it is seen that this function is divergent at a = 1/2 (see 
also below) and decays monotonously at large a. This 
decay is conrolled by an asymptotic expansion 



1 3 1 

2a 8a 2 4a 3 



(9) 



which is also shown on Fig. [5] It is seen that decay of 
lA a at large a obeys the inverse power law. It follows 



from Fig. [5] that the expansion © gives a very good 
approximation of U a for a > 3. 

We note that, apparently, Eq. © involves another 
divergence problems, if we choose integer a. This ob- 
stacle can be circumvented by transforming Eq. (|SJ) to 
an equivalent form that has no (effectively removable) 
divergencies. Namely, we get 



U a = — 7rtan7ra + ijj(a) — ip 



(10) 



and the tangent contribution vanishes for integer a. On 
the other hand, this expression shows that the divergence 
of U a at a — > 1/2 originates from the first term in (fTU)) . as 
tp functions have finite values at this point. Near a = 1/2 
the first term of Eq. ([TO)) diverges as (a — 1/2) _1 , which 
is clearly seen in Fig. [5J 

The preceding discussion shows that weak confinement 
properties of logarithmic potential manifest themselves in 
the fact that the corresponding (Cauchy family) equilib- 
rium pdfs exist only for the semi-infinite range of (dimen- 
sionless) inverse temperatures a £ (1/2, +00). Note that 
for strongly confining potentials (like e.g. V(x) ~ x 2 or 
x 4 ) this is not the case as it follows from Eq. ([2]) that the 
normalizing integral C _1 = exp[— XV(x)]dx is con- 
vergent at any A, so that the whole temperature range 
[0, 00) is allowed. 

Let us turn to a quantitative discussion of an impact 
of weak confinement properties of the above logarithmic 
potentials on thermodynamical properties of a random 
system. To this end, we should focus our attention on 
the thermodynamic meaning of the (originally Lagrange 
multiplier) parameter a and its semi-bounded range of 
variability (1/2, +00). This is also related to above prob- 
lem of explicit calculation of a for a specific pdf. 

With an explicit expression for Cauchy family pdfs ([5]) 
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FIG. 3: S a for Cauchy family (curve 1) and its asymptotic 
expansion at large a (curve 2) . for Gaussian family is 
also shown (curve 3). 



in hands, we readily evaluate Shannon entropy to obtain 

/oo 
p a (x)\n p a (x)dx = hi Z a + al4 a . (11) 
-oo 

Then, the (as yet dimensionless) Helmholtz free energy 
T a reads 



•F a — otLAot Sol — hi Z a , 



(12) 



with a being the dimensionless inverse temperature, c.f. 
Ref. @. 

We note, that in view of the divergence of Z a , both the 
Shannon entropy and the Helmholtz free energy (likewise 
U a ) cease to exist at a = 1/2. We plot S a as a function of 
a in FigEl It is seen that entropy monotonously decays 
for a > 1/2 and for larger values of a. An asymptotic 
expansion of the entropy shows logarithmic plus inverse 
power signatures 
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4a + 8^? 



(13) 



These series are shown along with the entropy in Fig. [3] 
As a grows, the number of moments of respective pelfs 
increases. That allows to expect that an "almost Gaus- 
sian" behavior should be displayed by a ^ 1 members of 
Cauchy family ([5]). This is indeed the case. To this end, 
let us recall that the normalized Gaussian function with 
zero mean and variance a 2 = l/2a reads 



7T 



1 



(14) 



The corresponding Shannon entropy gives exactly the 
first term of Eq. (JTSJ) 



(15) 



The plot of is reported in Figj3] together with <S a 
for Cauchy family. This equality suggests that at large 
a Cauchy family pdfs ([5]) transit to Gaussian one (|14|) . 
This transition can be revealed if we rewrite Cauchy fam- 
ily pdfs ([5]) in the exponential form p a (x) = exp(lnp a ) 
where hip a = — hiZ a — aln(l + x 2 ). It can be shown 
that at large a the "tails" of pdf do not make substantial 
contribution so that only small x play a role. This means 
that in limiting case of large a we can expand ln(l + x 2 ) 
at small x. Then, employing series expansions 
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we arrive at 

Pa{x) R 



8\/7ra 128av7ra 



exp 



(16) 



(17) 



whose leading order gives exactly the normalized Gaus- 
sian (fT4|). Accordingly, c.f. Fig. [3j an inequality a > 5 
sets a regime where a fairly good approximation of the 
Cauchy family pdfs by Gaussian is valid. Note that ul- 
timately, in the a —¥ oo limit, both families of functions 
(sequentially) approach the Dirac delta function(al). 

Let us now show that the variational principle ([1]) ex- 
plicitly identifies an equilibrium solution of the Fokker- 
Planck equation for standard Smoluchowski diffusion 
processes. To address our thermalization issue correctly, 
we now use dimensional units. The Fokker - Planck equa- 
tion that drives an initial probability density p(x, t = 0) 
to its final (equilibrium) form p(x,t — > oo) reads 



d t p = DAp - V • (b(x)p). 



(18) 



We still refer (although without substantial limitation of 
generality) to the ID case, so that V = d/dx. Here, 
the drift field b(x) is time-independent and conservative, 
b(x) = —\7V(x)/(mj) (V(x) is a potential, while m is a 
mass and 7 is a reciprocal relaxation time of a system). 
We keep in mind that p and bp vanish at spatial infinities 
or other integration interval borders. 

If Einstein fluctuation-dissipation relation D = 
ftBT/m-f holds, the equation (fT8|) can be identically 
rewritten in the form dtp — V[ / oV 1 F]/(m7), where 



* = V + k B T\np 



(19) 



whose mean value is indeed the Helmholtz free energy of 
random motion 



F = m = u- TS. 



(20) 



Here the (Gibbs) entropy reads S — ksS, while an inter- 
nal energy is U = (V) . In view of assumed boundary re- 
strictions at spatial infinities, we have F = —(rwy) (v 2 ) < 
0. Hence, F decreases as a function of time towards its 
minimum F±, or remains constant. 
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FIG. 4: Time evolution of pdf's p(x,t) for Smoluchowski processes in logarithmic potential ln(l + x 2 ). The initial (i = 0) pdf 
is set to be a Gaussian with height 25 and half- width ~ 1CP 3 . The first depicted stage of evolution corresponds to t = 0.01. 
Target pdfs are the members of Cauchy family © for a — 1 (panel (a)), 2 (panel (b)) and 3 (panel (c)) respectively. 



Let us consider the stationary (large time asymptotic) 
regime associated with an invariant density /?* (c.f. [7] for 
an extended discussion of that issue). Then, dtp = and 
we have V\t[p»] = Cp* (C is arbitrary constant) which 
yields 

p* = - exp[-V/k B T] . (21) 

Therefore, at equilibrium: 

*» =V + k B Thxp if = -k B ThxZ = F*, (22) 

to be compared with Eq. (IT21 . Here, the partition func- 
tion equals Z = J exp(—V/k B T)dx, provided that the 
integral is convergent. Since Z = cxp(— F*/k B T) we 
have recast p*(x) in the familiar Gibbs-Boltzmann form 
p. = exp[(F tt -Vyk B T\. 

On physical grounds, V(x) carries dimensions of en- 
ergy. Therefore to establish a physically justifiable ther- 
modynamic picture of Smoluchowski diffusion processes, 
relaxing to Cauchy family pdfs in their large time asymp- 
totics, we need to assume that logarithmic potentials 
V(x) = ln(l + x 2 ) are dimensionally scaled to the form 
V(x) — 6qV where eo is an arbitrary constant with phys- 
ical dimensions of energy. 

By employing (l/eo)F(a;) = ln(l + x 2 ), we can re- 
cast previous variational arguments (MEP procedure) 
in terms of dimensional thermodynamical functions. 
Namely, in view of k B TQ(x) — V(x) + k B T \np(x) we 
have an obvious transformation of Eqs. ([3]), §5§ and (fT2")) 
into Eqs. ([20 |) .([2i~ ]) and (|22j respectively with k B T$(x) = 

The above dimensional arguments tell us that in 
weakly confining logarithmic potentials, Cauchy family 
of pdfs can be regarded as a one-parameter family of 
equilibrium pdfs, where the reservoir temperature T en- 
ters through the exponent a. Proceeding in this vein, we 
note that eo should be regarded as a characteristic energy 
(energy scale) of the considered random system. 

We observe that a — > oo corresponds to T —> i.e. 
a maximal localization (Dirac delta limit) of the corre- 



sponding pdf. In parallel S(a -4(»eT^0)->0 and 
an analogy with the Nernst theorem is established. 

The opposite limiting case a — > 1/2 looks interesting 
as well. Namely, we have S(a — > 1/2) — > oo. To grasp 
the meaning of this limiting regime, we rewrite a = 1/2 
in the form k B T = 2cq. Accordingly, the temperature 
scale, within which our system may at all be set at ther- 
mal equilibrium, is bounded: < k B T < 2eo- For tem- 
peratures exceeding the upper bound T max = 2eo/k B no 
thermal equilibrium is possible in the presence of (weakly, 
i.e. weaker then, e.g., V(x) ~ x 2 ) confining logarithmic 
potentials V(x) = eo m(l + x 2 ). The case of a = 1 i.e. 
k B T = eo corresponds to Cauchy density. 

Let us finally add that in Ref. 0], we have analyzed 
diffusion processes in logarithmic potentials, with a focus 
on temporal relaxation patterns of the process towards 
asymptotic pdfs from the Cauchy family. For clarity of 
presentation (dynamical interpolation scenarios between 
initial Gaussian and equilibrium Cauchy-type pdfs do not 
seem to have ever been considered in the literature), in 
Fig. [4] we plot various stages of the diffusive Fokkcr - 
Planck dynamics for processes that all have been started 
from a narrow Gaussian. It turns out that the the resul- 
tant (large time asymptotic) equilibrium pdfs are mem- 
bers of Cauchy family , labeled respectively by a = 1 , 
2 and 3. 
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